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[57] ABSTRACT 

A process for scheduling a processor, in a stored pro- 
gram digital switch of a telecommunications network 
having heterogeneous types of task, utilizes preassigned 
probability parameters to schedule the tasks for the 
processor to serve to meet a system objective. For n 
types of tasks, each having one of n probability parame- 
ters Pi where 0<P/ < 1, the system first serves a type i 
task, then if queue i is empty, it serves a type i-f 1 modu- 
lus (n) task. If queue i is not empty, with a probability P/ 
it serves another type i task and with a probability 1-p,- 
it serves a type i+1 task modulus (n) until a type i+1 
task modulus (n) until a type i+1 task is served. Thus 
the processor continually cycles through all types of 
tasks. 

2 Claims, 4 Drawing Sheets 
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entries are voice circuit-switched calls, then the arrival 
CONTROL PROCESS FOR ALLOCATING pattern might be random and its duration random, with 

SERVICES IN COMMUNICATIONS SYSTEMS an average of a few minutes. On the other hand, if the 

entries are a digital ized data stream the inter-arrival 
CROSS-REFERENCE TO RELATED 5 time might be non-random and its duration much longer 

APPLICATION or much shorter than a few minutes, depending on its 

This is a continuation of copending application Sen specific application. The scheduling problem of con- 
No. 07/477,266 filed on Feb. 8, 1990 now abandoned, cern in this application is that of deciding in which 
which is a continuation-in-part of prior application Ser. order the entries should be processed in order to opti- 
No. 07/348,616, filed May 5, 1989 entitled CONTROL 10 mize the system's overall performance while taking into 
FOR RATIONING SERVICES AMONG DE- account the effects of the randomness in the system. 
MANDS WITH MULTIPLE PRIORITIES, now Hereinafter, the network traffic and other requests 
abandoned, which was a continuation of prior applica- for processor service will be called tasks and the difTer- 
tion Ser. No. 07/037,373, filed Apr. 13, 1987, now aban- ent classes of traffic will be called types of tasks. Differ- 
doned, said prior applications having the same inven- 15 ent types of tasks will be said to be in different queues, 
tors and assigned to the same assignee as the present A number of resource allocation or control schemes 
application. which involve control of access to a network computer 

u AricOBOIJNri OF THE INVENTION md optimization of message routing through a network 

BACKGROUND OF THE INVENTION ^ ^ proposed md to some extent implemented in 

This application pertains to the field of communica- 20 various networks. Some of these control schemes in- 
tions generally, and in particular to communication elude one or more schemes for resolution of the con- 
networks which interconnect a plurality of user stations fli cts wn ich can arise from multiple priorities. This 
and share a common resource. Specifically, it pertains aspect of the problem can be generalized to the schedul- 
to the allocation and scheduling of processor in a multi- of network resources to provide minimall y adequate 
queue system in which the service capabilities of the 25 service to ^ of a network. The prior art discloses 
processor are shared by the various queues in the sys- a numDer 0 f alternative techniques for scheduling the 
tern, the queues having heterogeneous types of tasks services of a network and/or its processor. Five prior 
with differing priorities, such as the allocation of real m schedules are discussed in the following paragraphs, 
time operation of a data processor in a large telephone ^ a ccmmunicat j CI1 network using bjx exhaustive 
switching center, or the allocation of bandwidth of the 30 ^^e, ^ ^tomm „ served from a first 

bus of a local area network. queue until the queue is empty before any customers are 

Commumcation networks range in scope from small from ^ next ^ stated in other terms, for 

local area networks connecting a few telephones or n _ (where represents ^ number of 

personal computers to the world-wuie public switehed ^nt ^m a system), the processor serves type i 
telephone network. Regar^ess of size ^ networks 35 mQre £ e J^li and then serves type 

mcrease in complexity more ^^ted^urce ^ ^ suffers from F a 

allocation policies become necessary. The allocation of of ^^tages. It does not permit the alloca- 

a single resource to many requests for its use is critical T , ' u , „Xr .i 

tothf central processor in Network switch. The result * on of P n °?? * e l ! * c ue pteSC fZ 

of ™i allocation scheme must be the optimiza- 40 *Wg has a very owpnonty, semce cannot be 

tion of a projected cost function. Similar concerns affect interrupted for an mcommg high priority task. Another 
comparable resource allocation schemes for smaller disadvantage is that the average delay of service, i.e., 
networks, in which performance improvement or sys- waiting time, of a type i task might be severely in- 
tern optimization yields an improvement in a projected creased when the number of type j tasks where j#i, 
cost function. 45 requiring service increases sharply. A further disadvan- 

The present invention is concerned primarily with tage is that such a schedule has no free parameters, thus 
networks under the control of a processor unit, usually does not permit real-time continuous variable control, 
a digital computer, having heterogeneous traffic, tasks I* * communication system using a gated schedule 
or requests for service. Specifically, it is concerned with all customers are served from a first queue who had 
one aspect of the task profile, namely the priority as- 50 arrived on that queue before service for the first as- 
signed to each type of task, and the measure of system tomer of that queue started, and then customers on the 
performance for that aspect, namely the response time next queue are served similarly. In other words, during 
or average mean delay of service for tasks in each each cycle, for i=0, 1, 2, . . . , n- 1, (where n represents 
queue In a network having heterogeneous classes of the number of different types of tasks in a system), the 
traffic with multiple priorities, there is a danger that 55 processor serves all of the type l tasks that arrived be- 
high priority traffic will continually preempt lower fore the first type i task was served and then the proces- 
priority traffic leading to the situation in which the low sor serves the type (i+ 1) modulus (n) tasks. A gated 
priority traffic is served after an inordinately long de- schedule has the disadvantage that it does not permit 
l ay the allocation of priorities among the tasks, and the 

An example is the allocation of a processor's time 60 disadvantage that it has no free parameters for real-time 
within a large switch. Such systems may be modeled by continuous variable control. 

a server, representing the processor, attending to the In a communication system using a clocked schedule, 
entries of two or more queues that arrive randomly and the processor serves all customers from a first queue 
have random service requirements, as illustrated in until the queue is empty, and then proceeds to serve 
FIG. 1. The entries might represent voice and/or data 65 customers on the next queue, as it would do on an ex- 
telecommunication traffic or internal messages from haustive service schedule, discussed above, except with 
one part of the processor to another. The statistical the modification that after every time period t (where t 
characteristics of the traffic could be quite varied: if the is prespecified) the processor stops what it is doing and 
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returns to the first queue. This type of schedule suffers 0 demand has been served, then with a probability of po, 

from the same disadvantages as the exhaustive service the preceding step is repeated, that is, another demand 

schedule plus the further disadvantage that its perfor- from the first queue is served, or with a probability 

mance cannot be analytically analyzed. Therefore some 1— po, a type 1 demand from the second queue of the n 

undesirable uncertainty on the part of the system de- 5 queues is served. These steps are repeated until a type 1 

signer is incurred. It also suffers the further disadvan- demand is served. If the first queue is empty after the 

tage that the implementation of such a schedule requires first type 0 demand is served, then with a probability of 

that the processor store in memory information about 1 a type 1 demand from the second of the n queues is 

the past activities of the system, that is, the schedule is served. In general, for i=0, 1, 2, . . . , n— 1, modulus (n) 

not memoryless. 10 the processor serves a first demand from the ith queue. 

In a communication system using a limited service If the ith queue is empty, it then serves the (i-f 1) modu- 

schedule, the processor serves up to a prespecified num- lus (n) queue. If the ith queue is not empty, with a prob- 

ber of customers on a first queue, then proceeds to serve ability P; it serves another demand on the ith queue, and 

up to a prespecified number on the next queue, cycling with a probability 1 — p/ it serves a demand on the (i+ 1) 

through all the queues in the system continuously. In IS modulus (n) queue, repeating the process until a demand 

other words, for i— 0, 1, 2, . . . , n— 1, (where n repre- from queue i-f-1 is served. The process is repeated for 

sents the number of different types of tasks in a system), all succeeding queues, as the processor cycles through 

the processor serves up to m/type i tasks (where m/s are queues 0, 1, 2, . . . , n— 1. 

prespecified integers) and then serves type (i+ 1) modu- In accordance with a second aspect of this invention, 
lus (n) tasks. This type of schedule suffers from the 20 a process for selecting which queue of customers to 
disadvantage that it has no free parameters for real-time serve in a stored program digital switch of a telecom- 
continuous variable control. It also suffers from the munications network, is implemented in a network con- 
disadvantage that it cannot be analytically analyzed. trol center by preassigning probability parameters po, 
And this schedule is also not memoryless. pi* Pfc - - • > Pn- 1» which parameters are each between 0 

In a communication system using a strict priority 25 and 1, (O^p^ 1), to the n queues respectively. In a first 
schedule, the processor serves all customers oh a queue step, the switch serves a type 0 source-destination re- 
having one priority only when there are no queues of quest from the first queue, of the n queues of requests. If 
customers having a higher priority. In other words, for the first queue is not empty after the first type 0 request 
i=0, 1, 2, . . . , n — 1, (where n represents the number of is served, then with a probability po the preceding step 
different types of tasks in a system), the processor serves 30 is repeated, that is, another request from the first queue 
type i tasks only when there are no type 1, 2, . . . i— 1 is served, or with a probability 1-po, a type 1 request 
tasks that need service. The strict priority schedule from the second queue of the n queues is served. If the 
suffers also from the disadvantage that the average first queue is empty after the first type 0 request is 
delay of service of a type i task might be severely in- served, then with a probability 1 a request from the 
creased when the number of type j tasks, where j<i, 35 second of the n queues is served. In general, for i=0, 1, 
requiring service, increases sharply. The strict priority 2, . . . , n — 1, modulus (n), the processor serves a first 
schedule also has no free parameters to allow real-time source-destination from the ith queue. If the ith queue is 
continuous variable control. V v. '^v empty, it then serves the (i 4- 1) queue modulus (n). If the 
oytww « v t^jS ^mSriAM ft* 1 Queue is not empty, with a probability p/ it serves 
SUMMARY OF THE INVENTION ^ ^ source-destination request from the ith queue 

iijhe principle object of the present "invention is to and with a probability 1— p/it serves a source-destina- 
^r^^^aJsyBtem fcf controlling the allocation of ser- tion request from the (i+ 1) modulus (n) queue, repeat- 
vice among classes of requests for service by scheduling ing the process until a source-destination request from 
^j^j^ptmBhoe of different types of tasks having dif- queue i+1 is served. The process is repeated for all 
ferent priorities based upon probabilities. 45 succeeding queues, as the processor cycles through 

Ajiother object of this invention is to provide for a queues 0, 1, 2, . . . , n— 1. 

new probabilistic schedule that can be used in a real- PRTp . nperprpTTnKr OF TWP nRAWlNfiS 

time control process incorporated into communication BRIEF DESCRIPTION OF THE DRAWINGS 

systems. FIG. 1 is a diagram representing a cyclic service 

Still another object of this invention is to provide for 50 queue; 

a new probability schedule which has significant com- FIG. 2 is a block diagram of one stored program 

mercial value and permits the optimization of a pro- control digital telephone switch; 

jected cost function for both local area networks and a FIG. 3 is a block diagram of the switch of FIG. 2 

processor schedule within a local telephone switch. showing traffic between the processors of that switch; 

Yet another object of this invention is to provide for 55 and 

a new priority schedule that offers superior perfor- FIG. 4 is a block diagram of the control process for 

mance over the prior art, especially in the minimization allocating service according to the invention. 

nfftZ^nrilT 86 ° f WaitiD8 timeS ° f ^ ° f DESCRIPTION OF THE PREFERRED 

differing priorities. EMBODIMENTS 

In accordance with a first aspect of this invention, in 60 nxvujuuirvm 

a multi-queue system having a processor serving n het- A computer serving a network switching system in a 

erogeneous queues of demands for service, the process telephone network performs many tasks. While it is 

is implemented in the processor by preassigning proba- primarily used to switch source-destination service re- 

bility parameters popi, P2» • * • , Pa- i* which parameters quests to an available trunk group, it also is responsible 

are each between 0 and 1, (OSp/gl), to the n queues 65 for data collection, data analysis, network diagnostics 

respectively. In a first step the processor serves a type 0 and plant maintenance. Hence, many types of tasks, 

demand from the first queue, of the n queues of de- each having its own priority, must be served by the 

mands. If the first queue is not empty after the first type computer resource. The allocation of the computing 
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resources to these tasks is the subject of the present 
application. 

FIG. 2 is a block diagram of the central control 
equipment unit 30 of the GTD-5 EAX, made by GTE 
Automatic Electric Incorporated, now AG Communi- 5 
cations, Phoenix, Ariz. This is a stored program control 
digital switching unit for Class 5 and Class 4/5 applica- 
tions adaptable to various central office sizes in a tele- 
phone system. As shown in FIG. 2, there are three types 
processors, 31, 32, 33, shown in the central control 10 
equipment 30. The call processing functions performed 
by these processors are shown in Table 1. 

TABLE 1 

ALLOCATION OF CALL PROCESSING FUNCTIONS , . 
TO PROCESSOR TYPE FUNCTION 13 



Processor Type 



Function 


AP 


TP 


TCU 


RSU 


RLU 


MXU CDL 


line control 






C 


c 


c 


cu 


PTS trunk control 






X 








COS 












X 


service circuit 






SP 


SBS 






control 














time switch and 






C 


c 






tone control 














concentration 






c 


c 


c 


cu 


caD sequencing 




SP 




SBS 






digit analysis 


SB 


SP 




SBS 






routing 


SB 


SP 




SBS 






charge data 




X 










collection 














configure network 


SP 


SB 




SBS 






logical device 


C 


C 




SBS 






control 














device usage 


SP 


SB 




SBS 






control 














resource 


SP 






SBS 




















charge data 


X 












output 















KEY: 

C ** cosmos function 

CU t= commoo fu nc tion, unique implementation 

SB b subset of pfW"»o» function, condition tl compilation and/or different data 
SP » superset of common function 

SBS «=» subset of common function used only daring survivability 
X s onfcpe location of function 

Each of these functions is one type of task. Some of the 
processors of Table 1 are not in central control unit 30. 
These processors must routinely and periodically run 
diagnostic programs, maintenance reports and billing 45 
data. Thus, each switch has a variety of tasks to per- 
form, each with its own priority, which priority may 
change in the course of time or unexpected events oc- 
curring in the network. The function of the control 
process for service allocation of the present invention is 50 
to schedule these various tasks of the individual intelli- 
gent switch processors to meet predefined network 
performance objectives. 

Of special current interest is the Administrative Pro- 
cessor Complex (APC) 31 of the GTD-5 which must 55 
allocate its real time among two or more classes of 
traffic each distinguished by different traffic statistics 
and different priorities. The Administrative Processor 
Complex (APC) 31 is one of three different types of 
processors within the GTD-5. FIG. 3 illustrates the 60 
interaction of the different processors. The APC 31 
handles system I/O, maintenance control memory up- 
date control, data collection, and data analysis (2). The 
Telephony Processor Controls (TPQ 32 perform the 
process control tasks for call processing, whereas the 65 
Peripheral Processors (PP) 33 handle device control 
and the interface between the lines, trunks, data links, 
and service circuits and the rest of the switch. The 
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processors interact through message distribution and 
memory sharing. Messages are sent and received be- 
tween processors via a set of queues located in the Mes- 
sage Distributor Circuit (MDQ 34. 

The APC's real-time requirements tend to increase 
with increasing traffic level. Some of the administrative 
tasks are of a higher priority than others. However, the 
needs of the high-priority tasks must be balanced, with 
the recognition that it is a high priority for the low-pri- 
ority tasks not to have excessively large average delays. 

The probability schedule according to the process of 
this invention is implemented by prespecifying a set of n 
numbers po> pi> • • • i p n -i, which are each between 0 
and 1 inclusively (0^p,^ 1), called probability parame- 
ters. These probability parameters are assigned to each 
of the n queues according to the operational objectives 
of the system and typically reflect relative priorities of 
the class of traffic or type of customer or task in each 
queue. For example, one central office digital switch in 
a telecommunications system may be reconfigured in 
the event of a failure at another switch having a number 
of different priorities. And it may have the usual range 
of diagnostic, maintenance and billing functions, some 
of which are low utilization and some of which are high 
utilization. In this context utilization refers to the rela- 
tive frequency of demands for processor time for each 
type of task. For purposes of illustration, we will as- 
sume the following profile of tasks and the probability 
parameters assigned to each type of task for the maximi- 
zation of revenues and rninimization of mean delay 
times to prevent defections from the network: 



Task Type 


Utilization 


Probability Parameters 


System I/O 


Very High 


po = 


1.0 


Memory Update Control 


Medium 


PI " 


0.8 


Data Analysis 


Very Low 


pa- 


0.6 


Data Collection 


High 


ra 13 


0.4 


Maintenance Control 


Low 


P4 « 


0.2 



It can be shown mathematically that the average 
mean delay time of each type of task will be a function 
of the arrival rate, the statistical properties of the ser- 
vice time and the probability parameters, and change- 
over time at any period of time. In this example, system 
I/O tasks are served exhaustively, and memory update 
tasks axe served nearly exhaustively. By assigning a 
relatively high probability parameter to a medium utili- 
zation class such as memory update control, this class 
will also"be served almost exhaustively, while the mean 
average time of delay system-wide will diminish. The 
assignment of probability parameters to achieve system 
objectives has been discussed in the literature, for exam- 
ple, "Average Delay Approximation of M/G/l Cyclic 
Service Queues with Bernoulli Schedules", L. D. Servi, 
IEEE Journal on Selected Areas in Communications, 
Vol. SAC-4, No. 6, September 1986. 

The probability parameters having been preassigned, 
the process proceeds according to the following steps. 
The processor of the central switch serves a request 
from the first queue hereinafter called a type 0 request 

With a probability po the processor serves the next 
type 0 request, if there is one available, and with a prob- 
ability (1— po) the processor serves a request from the 
next queue, a type 1 request This process continues 
until a type 1 request is served. 
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Then, with a probability pi the processor serves an- 
other type 1 request, if there is one available, and with 
a probability (1 — pi) the processor serves a request 
from the third queue, a type 2 request This process 
continues until a type 2 request is served. 5 

The processor repeats this procedure for type 4, 5, . . 
♦ ,n— 1 and then type 0 requests, as it cycles through the 
queues according to their respective priorities. To gen- 
eralize, for i =0, 1, 2, . . . , n— 1, modulus (n), the proces- 
sor serves a first service request from the ith queue. If 10 
the ith queue is empty, it then serves the (i+ 1) modulus 
(n) queue. If the ith queue is not empty, with a probabil- 
ity p, it serves another request from the ith queue, and 
with a probability 1 — p/ it serves a request from the 
(i+ 1) modulus (n) queue, repeating the process until a 15 
service request from queue i-f 1 modulus (n) is served. 
The process is repeated for all succeeding queues, as the 
processor cycles through queues 0, 1, 2, ... , n— 1. The 
processor of an intelligent central telecommunications 
switch uses this process to schedule its service to cus- 20 
tomers and/or users. 

The above-described probability schedule in accor- 
dance with this invention requires that the processor 
can generate random numbers to select one of the two 
probabilities, p/or 1— p/. The implementation of a ran- 25 
dom (or pseudo-random) number generator in a digital 
processor is well known in the art To select one of two 
probabilities p, or 1 — p& each of which is a real number 
between 0 and 1, such that O^p,^ 1, the processor gen- 
erates random numbers r uniformly distributed between 30 
0 and 1. At each selection, the random number r which 
is generated will be less than or equal to p/ with proba- 
bility p/, and the event associated with that probability 
will occur. Any other means for the processor to make 
a random selection between p/ and 1 — p/ may be utilized 35 
in the invention. 

A principal feature of this invention is the use of 
probabilities to implicitly allocate -priorities utilizing 
continuous variables, that is, non-integer variables. 
Continuous variables provide a means to implement a 40 
control, such as gradient methods, that would not be 
possible if integer control variables are used. 

A second feature of the invention is that its implemen- 
tation does not require storage in memory of any infor- 
mation concerning the past performance of the system. 45 

FIG. 4 is a flow chart depicting the process of the 
present invention. The processor has to service requests 
from n queues, where n^2, each queue n, i=0, 1, 2, . . 
. , n — 1, having its own respective priority expressed by 
a probability parameter p,-, where 0^p,^ 1. The present 50 
invention provides a means to schedule the service of 
the processor so that all requests for service are met 
while minimizing the mean delay time of the system. To 
start the system (box 41), the processor sets i=0 (box 
42), and checks to see if the queue of type i requests is 55 
empty (box 43). If the queue i is not empty, the proces- 
sor selects a type i (highest available priority) request 
for service and serves it (box 44). To determine the next 
request to be served according to the probability sched- 
ule of the present invention, the processor must make a 60 
random choice. It first generates a random number r, 
uniformly distributed between 0 and 1, (box 45). Then, 
with a probability p/, r^pi, box 46, the process returns 
to box 43. Else, with a probability 1 — p/ (box 45) r>p/ 
and the process then checks to see if i =n, the number of 65 
queues, box 47. If yes, all queues have been served and 
die process returns to box 12 to cycle through queues 0, 
1, 2, . . . , n— 1 again. Otherwise, the process increases 
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i by one (box 48) and then serves the i-f 1 modulus (n) 
queue, box 43. 

While the present inventors have constructed a new 
method for resource scheduling problems, it is to be 
understood that the claims of this invention relate only 
to the application of this novel method to arrangements 
that determine the optimum allocation or scheduling of 
resources in real world technological and industrial 
systems that lend themselves to a probabilistic represen- 
tation of the variables and constraints characterizing the 
system, i.e., physical arrangements that determine how 
resources are actually applied to optimize the perfor- 
mance of processes, machines, manufactures or compo- 
sitions of matter. All other uses of the new method, such 
as queuing theory research, or operations research ac- 
tivities, form no part of the present invention. Similarly, 
use of the new method in non-technological or non- 
industrial systems likewise form no part of the present 
invention. 
What is claimed is: 

1. A process executed by a computer for selecting by 
said computer a next sequential task to be allocation 
service of a computer processor while scheduling the 
allocation of services of the computer processor among 
two or more queues of tasks wherein said queues Q/are 
sequentially numbered for i equal to 0, 1, 2, ... , n— 1, 
comprising the steps of: 

receiving by said computer probability parameters po, 
. . . pn_ i, where 0^ry=i 1 for indicating the relative 
priorities of said queues 0,; 
assigning by said computer each of said probability 

parameters p/ to a respective queue Qr, 
selecting by said computer a task from queue Q/ for 

allocation of service of said computer processor 
determining by said computer if there is at least an- 
other task in queue Qs 
selecting by said computer a task from queue Q/+i 
modulus (n) for allocation of service of said com- 
puter processor, having no other task in queue Qr, 
performing the following steps if there is at least 

another task in queue Qr, 
generating by said computer a random number M 

where O^M^l; 
comparing by said computer said random number M 

to said probability parameter p,; 
selecting by said computer the next sequential task to 
be allocated service of the computer processor, 
from said tasks in the next sequential queue Q/+i 
modulus (n) if M>p/ and selecting by said com- 
puter the next sequential task to be allocated ser- 
vice of the computer processor, from said tasks in 
queue Q,if M<p/. 

2. A computer for selecting a next sequential task to 
be allocated service of a computer processor while 
scheduling the allocated of services of the computer 
processor among two or more queues of tasks wherein 
said queues Q ( - are sequentially numbered for i equal to 
0, 1, 2, ... , n— 1, comprising the steps of: 

means for receiving by said computer probability 
parameters po, . . . , pn-i, where 023 p^l for 
indicating the relative priorities of said queues Qr, 
means for assigning by said computer each of said 
probability parameters p/ to a respective queue Qr, 
means for selecting by said computer a task from 
queue Q; for allocation of service of said computer 
processor; 

means for determining by said computer if there is at 
least another task in queue Qr, 
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means for selecting by said computer a task from 
queue Q/ + i modulus (n) for allocation of service of 
said computer processor, having no other task in 
queue Q*; 

means for generating by said computer a random 

number M where 0—M ^ 1; 
means for comparing by said computer said random 

number M to said probability parameter p/ if there 

is at least another task in queue Q,~, 



10 



means for selecting by said computer the next sequen- 
tial task to be allocated the computer processor if 
there is at least another task in queue Q tf from said 
tasks in the next sequential queue Q/+ 1 modulus (n) 
If M>pi and means for selecting by said computer 
the next sequential task to be allocated service of 
the computer processor, from said tasks in queue 
Q/if M<pi. 
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